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SYSTEM AND METHOD FOR EFFICIENTLY VISUALIZING 
AND COMPARING COMMUNICATION NETWORK SYSTEM 

PERFORMANCE 

DESCRIPTION 
5 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention generally relates to engineering and 
management systems for the design of wireless and wired communication 
systems and, more particularly, to a method for comparing the performance 
10 of wireless and wired systems in any environment (e.g., buildings, floors 
within a building, campuses, within cities, an outdoor setting, etc.) using a 
three-dimensional (3-D) visualization method. 

Description of the Prior Art 

As communication systems proliferate, radio frequency (RF) 
coverage within and around buildings, and radio signal penetration into 
and out of buildings, has become a critical design issue for 
communications engineers who must design and deploy cellular telephone 
systems, paging systems, or new wireless technologies such as personal 
communication systems (PCS), wireless local area networks (WLAN), and 
local multi-point distribution systems (LMDS). Emerging hand-held 
appliances will increasingly use wireless access methods, necessitating the 
need for tools and methods that allow technicians and engineers to rapidly 
install such wireless infrastructure. Also, the fiber optic and baseband 
networks needed to cany internet traffic will proliferate rapidly in the 
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future, as well. In addition, RF networks involving micromachinery, RF 
identification tags, and optical communication links are of increasing 
interest due to the rapid miniaturization of communication devices and 
sensors, and the rapid proliferation of fiber optic bandwidth in and around 
5 campuses. Designers are frequently requested to determine if a radio 

transceiver location or base station cell site can provide adequate, reliable 
service throughout a room, a building, an entire city, a campus, a shopping 
mall, or any other environment. The costs of in-building and microcellular 
wireless communication devices are diminishing while the workload for 
10 wireless system design engineers and technicians to deploy such systems is 
increasing sharply. Given these factors, rapid engineering design and 
deployment methods accompanied by comprehensive system performance 
visualization and analysis methods are vital to wireless communication 
system designers. 

15 In addition, recent research efforts by AT&T Laboratories, 

Brooklyn Polytechnic, and Virginia Tech are described in papers and 
technical reports entitled: S. Kim, B. J. Guarino, Jr., T. M. Willis III, V. 
Erceg, S. J. Fortune, R A, Valenzuela, L. W. Thomas, J. Ling, and J. D. 
Moore, "Radio Propagation Measurements and Predictions Using Three- 

20 dimensional Ray Tracing in Urban Environments at 908 MHZ and 1 .9 

GHz," IEEE Transactions on Vehicular Technology, vol 48, no. 3, May 
1999 (hereinafter "Radio Propagation"); L. Piazzi, H. L. Bertoni, 
"Achievable Accuracy of Site-Specific Path-Loss Predictions in 
Residential Environments," IEEE Transactions on Vehicular Technology, 

25 vol. 48, no. 3, May 1999 (hereinafter "Site-Specific"); G. Durgin, T. S. 

Rappaport, H. Xu, "Measurements and Models for Radio Path Loss and 
Penetration Loss In and Around Homes and Trees at 5.85 GHz," IEEE 
Transactions on Communications, vol. 46, no. 11, November 1998; 
T. S. Rappaport, M. P. Koushik, J. C. Liberti, C. Pendyala, and T. P. 

30 Subramanian, C£ Radio Propagation Prediction Techniques and Computer- 
Aided Channel Modeling for Embedded Wireless Microsystems," ARPA 
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Annual Report, MPRG Technical Report MPRG-TR-94-12, Virginia Tech, 
July 1994; T, S. Rappaport, M. P. Koushik, C. Carter, and M. Ahmed, 
"Radio Propagation Prediction Techniques and Computer- Aided Channel 
Modeling for Embedded Wireless Microsystems," MPRG Technical 
Report MPRG-TR-95-08, Virginia Tech, July 1994; T. S. Rappaport, M. P. 
Koushik, M. Ahmed, C. Carter, B. Newhall, and N. Zhang, "Use of 
Topographic Maps with Building Information to Determine Antenna 
Placements and GPS Satellite Coverage for Radio Detection and Tracking 
in Urban Environments," MPRG Technical Report MPRG-TR-95-14, 
Virginia Tech, September 1995; T. S. Rappaport, M. P. Koushik, M. 
Ahmed, C. Carter, B. Newhall, R Skidmore, and N. Zhang, "Use of 
Topographic Maps with Building Information to Determine Antenna 
Placement for Radio Detection and Tracking in Urban Environments," 
MPRG Technical Report MPRG-TR-95-19, Virginia Tech, November 
1995; and S. Sandhu, M. P. Koushik, and T. S. Rappaport, "Predicted Path 
Loss for Rosslyn, VA, Second set of predictions for ORD Project on Site 
Specific Propagation Prediction," MPRG Technical Report MPRG-TR-95- 
03, Virginia Tech, March 1995. 

The papers and technical reports are illustrative of the state-of-the- 
art in site-specific radio wave propagation modeling. While most of the 
above papers describe a comparison of measured versus predicted RF 
signal coverage and present tabular or two dimensional (2-D) methods for 
representing and displaying predicted data, they do not report a 
comprehensive method for visualising and analyzing wireless system 
performance. The "Radio Propagation" and "Site-Specific" papers make 
reference to 3-D modeling, but do not offer novel display methods or - 
graphical techniques to enable a user to visualize signal coverage or 
interference in 3-D. Furthermore, there do not exist effective methods that 
allow a wireless communications technician or designer to rapidly display 
predicted performance values, or to compare, through visualization, 
differences in predicted performance values between alternate network 



design concepts within a particular specified environment. 

Common to all wireless communication system designs as well as 
wired network designs is the desire to maximize the performance and 
reliability of the system while minimizing the deployment costs. Ways to 
minimize cost include the use of computer aided design tools that manage 
many aspects of the design process. Such tools also help create methods 
that enable the engineer or technician to work quickly. Consider a wireless 
system, for example. Analyzing radio signal coverage and interference is 
of critical importance for a number of reasons. A design engineer must 
determine if an environment that is a candidate for a wireless system 
contains too much noise or interference, or if the existing wireless system 
will provide sufficient signal power throughout the desired service area. 
Alternatively, wireless engineers must determine whether local area 
coverage will be adequately supplemented by existing large scale outdoor 
wireless systems, or macrocells, or whether indoor wireless transceivers, or 
picocells, must be added. The placement of these cells is critical from both 
a cost and performance standpoint. The design engineer must predict how 
much interference can be expected from other wireless systems and where 
it will manifest itself within the environment. Prediction methods which 
are known to the inventors and which are available in the literature provide 
well accepted methods for computing coverage or interference values for 
many cases. However, the implementation of such models are generally 
very crude, and rely on cumbersome spreadsheets, or inefficient operating 
platforms in research laboratories with little support and little visualization 
capability. Inevitably, performance measurements must be made in the 
environment of interest in order to generate the proper prediction models, 
or to at least verify the chosen prediction models for acceptable accuracy or 
reliability. 

Depending upon the design goals, the performance of a wireless 
communication system may involve a combination of one or more factors. 
For example, the total area covered in adequate received signal strength 
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(RSSI), the area covered in adequate data throughput levels, and the 
number of customers that can be serviced by the system are among the 
deciding factors used by design engineers in planning the placement of 
communication equipment comprising the wireless system. Thus, 
5 maximizing the performance of a wireless system may involve the 

complex analysis of multiple, potentially unrelated factors. The ability to 
display the results of such analysis in a manner easily interpretable by 
design engineers is invaluable in wireless system deployment. Three 
dimensional (3-D) visualization of wireless system operating parameters 

10 provides the user with rapid assimilation of large data sets and their 

relation to the physical environment. As wireless systems proliferate, these 
issues must be resolved quickly, easily, and inexpensively, in a systematic 
and repeatable manner. 

There are many computer aided design (CAD) products on the 

15 market that can be used to design a computerized model of an 

environment. WiSE™ from Lucent Technology, Inc., SignalPro™ from 
EDX, PLAnet™ by Mobile Systems International, Inc., (later known as 
Metapath Software International, now part of Marconi, P.L.C.) and TEMS 
from Ericsson , Wizard by Safco Technologies, Inc. (now part of Agilent 

20 Technologies, Inc.), are examples of CAD products developed to aid in the 
design of wireless communication systems. 

Lucent Technology, Inc., offers WISE™ as a design tool for 
wireless communication systems. The WiSE system predicts the 
performance of wireless communication systems based on a computer 

25 model of a given environment using a deterministic radio coverage 
predictive technique known as ray tracing. 

EDX offers SignalPro® as a design tool for wireless 
communication systems. The SignalPro system predicts the performance 
of wireless communication systems based on a computer model of a given 

30 environment using a deterministic RF power predictive technique known 
as ray tracing. 

5 
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Mobile Systems International, Inc., (now a part of Marconi, 
P.L.C.), offers PLAnet™ as a design tool for wireless communication 
systems. The PLAnet system predicts the performance of macrocellular 
wireless communi cation systems based upon a computer model of a given 
environment using statistical and empirical predictive techniques. 
Ericsson Radio Quality Information Systems offers TEMS™ as a design 
and verification tool for wireless communication indoor coverage. The 
TEMS system predicts the performance of indoor wireless communication 
systems based on a building map with input base transceiver locations and 
using empirical radio coverage models. 

The above-mentioned design tools have aided wireless system designers by 
providing facilities for predicting the performance of wireless 
communication systems and displaying the results in the form of flat, two- 
dimensional grids of color or flat, two-dimensional contour regions. Such 
displays, although useful, are limited by their two-dimensional nature in 
conveying all nuances of the wireless system performance. For example, 
slight variations in color present in a two-dimensional grid of color, which 
may represent changes in wireless system performance that need to be 
accounted for, may be easily overlooked. Furthermore, as wireless systems 
proliferate, the ability to visually predict and design for coverage and 
interference is of increasing value. 

Common to all communication system designs, regardless of 
technology, size or scale, is the need for measurement data at some point in 
the design process. For environments which are candidates for wireless 
communication systems, it is essential to first conduct a measurement 
campaign to determine spectral occupancy, noise levels, interference 
levels, or available channels. 

Whether in the initial design stage or the final verification stage, or 
during ongoing maintenance during the lifecycle of a communication 
system, no communication system is implemented without the input and 
use of measurement data. However, measurement acquisition within 
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in-building environments is much more tedious and time consuming than 
in the macrocellular environment where measurement acquisition is carried 
out using Global Positioning System data to determine the location of the 
measurement being taken. Global Positioning System (GPS) data, which 
5 so many RF engineers have come to rely upon for outdoor measurement 
acquisition, is not an option for microcell environments in most cases, and 
is extremely difficult to use reliably within buildings, due to the clutter and 
resulting attenuation of the GPS satellite signal levels within urban areas 
and within manmade structures. While new methods, such as the 

10 Qualcomm SnapTrack indoor GPS system may offer long-term promise 
for in-building location, today's readily available GPS solutions are 
expensive and are seldom available to engineers or technicians tasked with 
the deployment, measurement, or optimization of in-building or microcell 
networks. Therefore, recording real-time measurement data within a 

15 building becomes a laborious, time-consuming task involving scratched 

notes and blueprints and manual data entry which are both expensive and 
ineffectual in many respects. 

In addition to measuring RF signal properties from emitted base 
transceivers there is also a need to measure data throughput time in 

20 computer data networks. Throughput time is the time required to transfer a 

record or file of known size from one computer to another. In order to 
standardize the measurement of data throughput time for comparison or 
verification purposes, files of a set size (e.g., 100K) are used and 
transferred in packet sizes such as 5 12 bytes. Similar to RF signal 

25 attenuation, data throughput time, and each of a many number of other 
important network measurement parameters, such as packet latency, bit 
error rate, packet error rate, and bit rate throughput, is also a function of 
transmission distance and signal obstruction (e.g. walls, doors, partitions), 
as well as multipath propagation and the specific radio modem design. 

30 Presently, there are no known effective visualization techniques 

that allow an engineer or wireless technician to display measurement 

7 
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results or rapidly compare, through visualization, various measurement 
results of various performance measurements of a particular 
communication network, or collection of networks, within a particular 
specified environment over time, frequency, or space. Various signal 
property measurement acquisition tools and systems have been developed 
to aid in the design of wireless communication systems such as PenCat™, 
Walkabout PCS™ and TEMS Light. 

LCC International Inc. offers the PenCat™ as a pen-based 
collection and analysis tool for wireless communication design that runs on 
a small hand-held tablet computer. The PenCat™ system enables a user to 
roam about a building, take signal property measurement data at a location 
in the building using a receiver linked to the tablet computer, and link the 
measured data to that building location on a computer map representing the 
building by tapping the appropriate portion of the map on the computer 
screen with a stylus pen. The building map can be entered into the 
PenCat™ system by either scanning blueprints, sketching the building 
within the application, or importing from another source. PenCAT uses 
two dimensional bit maps to model the building environment. 
Safco Technologies, Inc. (now part of Agilent Technologies, Inc.) offers 
the Walkabout PCS™ system as a portable survey coverage system for use 
in indoor or outdoor wireless communication system design. Similar to 
PenCat™, the Walkabout PCS™ system utilizes a hand-held computer 
linked to a receiver for measuring signal properties at a given location and 
linking the measured property data to that location represented on a stored 
computer map. Also similar to the Safco Walkabout is the Agilent 74XX 
indoor measurement system, which also uses a bitmap floor plan. 
Ericsson Radio Quality Information Systems offers the TEMS Light 
system as a verification tool for wireless communication indoor coverage. 
The TEMS Light system utilizes a Windows-based graphical interface with 
two dimensional bit map drawings on a mobile computer linked to a 
receiver to allow a user to view a stored building map, make location 
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specific data measurements, and link the measured data to the represented 
location on the stored computer map. Unlike other in-building 
communication measurement systems, InFielder™ by Wireless Valley 
Communications, Inc. merges measurement data with periodic updates of 
5 position location on a three-dimensional model of the physical 

environment. The InFielder™ product concept is disclosed in U.S. Patent 
Application Serial No. 09/221,985 filed December 29, 1998, and the 
contents of this application are herein incorporated by reference. However, 
as originally disclosed in the aforementioned patent application, InFielder, 
10 does not offer an efficient method for rapidly viewing and comparing 
measurement data in a 3-D environment such that measurement values, 
and comparisons of measurement values, may be quickly determined and 
inferred by the user. 

SUMMARY OF THE INVENTION 

15 It is therefore an object of the present invention to facilitate the 

display of predicted performance results and the display of comparisons 
between predicted performance results for wireless or wired 
communication systems. 

It is another object of the present invention to provide a mechanism 
20 for displaying predicted performance results and displaying the 

comparisons between predicted performance results for wireless or wired 
communication systems. 

It is another object of the present invention to facilitate the three- 
dimensional, multi-colored display of predicted performance results and 
25 comparisons between predicted performance results for any type of 
wireless or wired communication system. 

It is another object of the present invention to provide a mechanism 
for viewing a three-dimensional display of predicted performance results 
and comparisons between predicted performance results from any angle, 

9 
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orientation, distance, or perspective. 

It is another object of the present invention to provide a mechanism 
for viewing a three-dimensional display of predicted performance results 
and comparisons between predicted performance results and interacting 
with the display in real-time to alter the current viewpoint and perspective. 

It is another object of the present invention to provide said display 
of predicted performance results and comparisons between predicted 
performance results overlaid on a three-dimensional database that may 
involve a plurality of building structures and the surrounding terrain, flora, 
climatic conditions, and additional static and dynamic obstacles (e.g., 
automobiles, people, filing cabinets, etc.). 

It is another object of the present invention to provide a mechanism 
for coloring, shading, and otherwise rendering a solid representation of 
said three-dimensional display utilizing multiple colors and transparency 
effects. 

In addition to the above, it is yet another object of the present 
invention to facilitate the display of measurements and the display of 
comparisons between measured performance results for wireless or wired 
communication systems. 

It is another object of the present invention to provide a mechanism 
for displaying measurements and displaying the comparisons between 
measured performance results for wireless or wired communication 
systems. 

It is another object of the present invention to facilitate the three- 
dimensional, multi-colored display of measurements as well as 
comparisons between measured performance results for any type of 
wireless or wired communication system. 

It is another object of the present invention to provide a mechanism 
for viewing a three-dimensional display of measurements as well as 
comparisons between measured performance results from any angle, 
orientation, distance, or perspective. 
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It is another object of the present invention to provide a mechanism 
for viewing a three-dimensional display of measurements as well as 
comparisons between measured performance results and interacting with 
the display in real-time to alter the current viewpoint and perspective. 
5 It is another object of the present invention to provide said display 

of measurement performance results as well as said display of comparisons 
between measured performance results overlaid on a three-dimensional 
database that may involve a plurality of building structures and the 
surrounding terrain, flora, climatic conditions, and additional static and 
10 dynamic obstacles (e.g., automobiles, people, filing cabinets, etc.). 

It is another object of the present invention to provide a mechanism 
for coloring, shading, and otherwise rendering a solid representation of 
said three-dimensional display utilizing multiple colors and transparency 
effects. 

15 In addition to the above, it is yet another object of the present 

invention to facilitate the comparisons between predicted and measured 
performance results for wireless or wired communication systems. 

It is another object of the present invention to provide a mechanism 
for displaying the comparisons between predicted and measured 

20 performance results for wireless or wired communication systems. 

It is another object of the present invention to facilitate the three- 
dimensional, multi-colored display of comparisons between predicted and 
measured performance results for any type of wireless or wired 
communication system. 

25 It is another object of the present invention to provide a mechanism 

for viewing a three-dimensional display of comparisons between predicted 
and measured performance results from any angle, orientation, distance, or 
perspective. 

It is another object of the present invention to provide a mechanism 
30 for viewing a three-dimensional display of comparisons between predicted 
and measured performance results and interacting with the display in real- 
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time to alter the current viewpoint and perspective. 

It is another object of the present invention to provide said display 
of comparisons between predicted and measured performance results 
overlaid on a three-dimensional database that may involve a plurality of 
building structures and the surrounding terrain, flora, climatic conditions, 
and additional static and dynamic obstacles (e.g., automobiles, people, 
filing cabinets, etc.). 

It is another object of the present invention to provide a mechanism 
for coloring, shading, and otherwise rendering a solid representation of 
said three-dimensional display utilizing multiple colors and transparency 
effects. 

According to the present invention, a system is provided for 
allowing a RF system designer or a communication network designer to 
dynamically model a wired or wireless system electronically in any 
environment. The method includes the selection and placement of models 
of various wireless or optical or baseband communication system hardware 
components, such as antennas (point, omnidirectional, directional, leaky 
feeder, distributed, etc.), base stations, base station controllers, 
transceivers, amplifiers, cables, splitters, attenuators, repeaters, wireless 
access points, couplers, connectors, connection boxes, splicers, switches, 
routers, hubs, transducers, translators (such as devices which convert 
between RF and optical frequencies, or which convert between RF and 
baseband frequencies, or which convert between baseband and optical 
frequencies, and devices which translate energy from one part of the 
electromagnetic spectrum to another), power cables, twisted pair cables, 
optical fiber cables, and the like, and allows the user to visualize, in three- 
dimensions, the effects of their placement and movement on overall system 
performance throughout the modeled environment. Thus, the placement of 
components can be refined and fine-tuned prior to actual implementation 
of a system or network , wherein performance prediction modeling or 
measurement may be used for design and deployment; and to ensure that 
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all required regions of the desired service area are blanketed with adequate 
connectivity, RF coverage, data throughput, or possess other required 
network system performance values, such as acceptable levels of quality of 
service (QoS), packet error rate, packet throughput, packet latency, bit 
5 error rate, signal-to-noise ratio (SNR), carrier-to-noise ratio (CNR), signal 
strength or RSSI, rms delay spread, distortion, and other commonly used 
communication network performance metrics, known now or in the future, 
which may be measured or predicted and which may be useful for aiding 
an engineer in the proper installation, design, or maintenance of a wired or 

10 wireless communications network. In the case of an optical or baseband 
wired network, for example, the placement and performance of 
components can be visualized within the invention to ensure that proper 
portions of the environment are supplied with service, so that users within 
the environment may connect directly (with a hardwired connection) or via 

15 a wireless or infrared connection which can be provided throughout the 

wired network using translators, converters, wireless access points, and 
other communication components that facilitate frequency translation and 
wireless access from the wired network. The three-dimensional 
visualization of system performance provides RF and network system 

20 designers with tremendous insight into the functioning of the modeled 
wireless or wired communication system, and represents a marked 
improvement over previous visualization techniques. 

To accomplish the above, a 3-D model of the physical environment 
is stored as a CAD model in an electronic database. The physical, 

25 electrical, and aesthetic parameters attributed to the various parts of the 
environment such as walls, floors, foliage, buildings, hills, and other 
obstacles that affect radio waves or which impede or dictate the routing of 
wiring paths and other wired components are also stored in the database. 
A representation of the 3-D environment is displayed on a computer screen 

30 for the designer to view. The designer may view the entire environment in 
simulated 3-D, zoom in on a particular area of interest, or dynamically alter 

13 
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the viewing location and perspective to create a "fly-through" effect. 
Using a mouse or other input positioning device the designer may select 
and view various communication hardware device models that represent 
actual communication system components from a series of pull-down 
menus. A variety of amplifiers, cables, connectors, and other hardware 
devices described above which make up any wired or wireless 
communication system or network may be selected, positioned, and 
interconnected in a similar fashion by the designer to form representations 
of complete wireless or wired communication systems. 

In the present invention, the designer may run performance 
prediction calculations, measure actual performance characteristics within 
an environment, or gather performance data using some other method 
known now or in the future. A point of novelty of the current method and 
apparatus is for displaying the results of measurements, comparisons of 
measurements, and comparisons of predicted performance results using a 
3-D visualization method that is well suited for use within the 3-D model 
of the physical environment such that an engineer or technician can rapidly 
determine the meaning or importance of the measurement or comparison 
of measurements or comparison of performance results while viewing the 
display within the electronic model of the environment which shows the 
approximate or exact location from where each measurement or the 
comparison of measurements or comparison of performance results were 
collected or computed. 

The method presented additionally provides a means for visualizing 
a 3-D iconic view of predicted performance values. Using a cylindrical or 
other shape object with varying height and color, the present invention 
allows for rapid visualization of complex performance data at a select 
number of points in the environment termed 'Nvatch points". The present 
invention extends the prior art in this area by allowing a designer a quick, 
3-D view of performance data overlaying the environment model. 

The present invention additionally creates a new method and 
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system for providing a way to conveniently visualize individual 
measurement watch points for rapid inference of meaning, as well as 
conveniently visualizing and rapidly inferring the meaning of differences 
between measurement runs collected within the same 3-D environment, 
5 using the same or different communication network designs. A 

measurement run is a series of measurements, usually performed by a 
technician or engineer within an environment (such as a city, a town, a 
campus, a group of buildings, or a building of interest), although such 
measurements may be carried out by non-technical people and may even 

10 be carried out remotely or autonomously (e.g., by measurement devices 
used by a number of technicians walking through the physical 
environment, each being outfitted with a measurement device which 
randomnly makes measurements and where these measurements are all 
shared; this being more adequately described in U.S. Serial No. 09/ , 

15 filed July 28, 2000 entitled "System, Method and Apparatus for Portable 
Design, Deployment, Test and Optimization of a Communication 
Network, which is herein incorporated by reference). 

The invention supports the rapid visualization and display for 
comparing performance data gathered from a multitude of sources. The 

20 comparisons may be between two or more different sets of measurements 
made within the same 3-D environment of interest as described above. 
However, the comparisons may also be between two or more sets of 
network system performance prediction results that may be computed, 
displayed, or stored for latter display. The present invention creates a new 

25 method and system for providing a way to rapidly visualize the differences 
between different network system performance prediction results collected 
within the same 3-D environment, using similar or different 
communication network designs within the common environmental model. 
In addition to the above considerations, the present invention 

30 provides a means of displaying the differences between measured data and 
predicted data in a convenient manner which yields great insight into 

15 



SDOCID: <WO 0213009A1_I_> 



actual versus predicted performance of any communications network. 
Based on the above teaching, it should be clear that measured data and 
predicted data may be displayed in a 3-D environment, and may be 
overlaid upon each other in space, in order to provide a registration of 
measured and predicted values. In this manner, it is possible to compare 
measurement runs to prediction runs, so long as the measurements are 
collected at points which are specified as desired locations for outputs of 
the prediction engine. One of ordinary skill in the art would be trained in 
data processing and error analysis and would be able to understand how 
novel visualization techniques that apply to: a) measured data, b) the 
comparison of measured data, and c) the comparison of predicted data 
could also be applied to the comparison of measured to predicted data. 
Using the novel visualization methods which are described subsequently to 
compare measured versus predicted values offers tremendous power for 
engineers who seek to develop and optimize and use prediction models 
that perform most accurately in particular physical environments. 

Comparisons of data points between prediction runs, measurement 
runs, or comparisons between prediction and measurement runs may be 
made in several ways. Data sets can be compared on a simple difference 
basis, where the numerical value of the data point in the first run (located 
at a specific location in the environmental database) is subtracted from the 
data point at the same corresponding location from the second run. Of 
course, the subtraction order may be reversed if preferred. Other ways of 
comparing data include computing a decibel (dB) difference, which 
corresponds to a logarithmic ratio of the two numerical values at the same 
location point. Alternatively, a relative value, which considers the largest 
or best value having a maximum value (say 100 or 1), and the smaller 
value is displayed as having a value less than the maximum. The level 
below the maximum value may be computed and displayed as the 
normalized value, or as a percentage, as compared to the maximum. 

One difficulty in comparing measured data with predicted data, or 
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comparing measurements or predictions that have been performed with 
different grid scales or data base resolutions is that the same corresponding 
location between the two data sets may not be tractable, for example, due 
to inexactness of registering position information of the field 
5 measurements with the modeled environmental location in the predictions. 
In this case, a nearest neighbor approach for point selection, or a random 
selection technique from a cluster of nearest neighbor points, may be made 
in order to determine the suitable point in each run to compare between. 
Or, an averaging method may be used, whereby local points in each of the 

10 data sets to be compared are averaged within a very small local area, and 
the resulting numerical values from each set are compared at a physical 
location point which is common to the small region occupied by the points 
used for averaging in each data set. This is known as "local averaging", 
and statistics may be deduced from the mean and variation of the local 

15 average of data in a particular run. These statistics may be compared and 
differences displayed between the statistics of each of the two runs under 
comparison. There are numerous other comparison methods that may be 
used to compare numerical values from two sets, and such comparison 
methods are considered, whether or not known now or in the future. 

20 Some data sets may be sparse compared to others which are offered 

up for comparison. In this case, a display mechanism is needed to 
illustrate that a comparison at a particular 3-D location point may not be 
made because of missing data from one or both of the sets. 

The preferred embodiment of the invention allows for the 

25 visualization of such comparisons using a variety of methods. Building on 
the concepts disclosed in co-pending application 09/3 1 8,840, entitled 
"Method and System for Automated Optimization of Antenna Positioning 
in 3-D", the present invention allows for one or more locations in space to 
serve as "watch points" where comparisons are stored as part of a 3-D 

30 computer database and visualized on a display screen. The display of said 
watch points may be in a 2-D manner utilizing colors, shape, and/or text to 
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indicate comparison data, or in a 3-D manner using height, color, shape, 
and/or text to indicate comparison data. 

In addition to visualization at one or more watch points, the present 
invention allows for a mesh of vertices indicating comparison data to be 
overlaid on top a selected region of any size or shape. 

The computer displays on the screen at each vertex of the mesh the 
comparison data indicating variations in RF performance values, for 
instance, received signal strength intensity (RSSI), network throughput, 
packet latency, packet error rate, quality of service (QoS), bit error rate, 
frame error rate, signal-to-interference ratio (SIR), and signal-to-noise ratio 
(SNR), provided by the communication systems just designed. The display 
is such that the computer adjusts the elevation and/or coloring including 
characteristics such as saturation, hue, brightness, line type and width, 
transparency, surface texture, etc., of each vertex relative to the 
surrounding vertices to correspond to the calculated comparisons of RF 
performance values. The coloring and elevation may correspond to the 
same calculated comparison value or to different variations in calculated 
comparison values. For example, elevation may correspond to comparisons 
between received signal strength intensity (RSSI), and color may 
correspond to comparisons between signal-to-noise ratio (SNR), or any 
other of a variety of comparisons between calculated RF parameters. The 
user is able to specify boundaries for this display in terms of selecting the 
range of elevations, colors, or other aesthetic characteristics from which 
the vertices of the mesh are assigned. Alternatively, the system can 
automatically select limits and ranges for the heights, colors, and other 
aesthetic characteristics. The result is a region of fluctuating color and 
elevation representing the changing comparisons between wireless system 
performance throughout different portions of the modeled 3-D 
environment. The region may be viewed as an overlay within the 3-D 
environment. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and advantages will be 
better understood from the following detailed description of a preferred 
embodiment of the invention with reference to the drawings, in which: 
5 Figure 1 shows an example of a simplified layout of a floor plan of 

a building; 

Figure 2 shows a three-dimensional perspective of a building floor 

plan; 

Figure 3 shows a three-dimensional perspective of a comparison of 
10 a set of performance values; 

Figure 4 shows an example region segmented into a grid that has 
been selected by a RF designer for displaying wireless system 
performance; 

Figure 5 shows a region similar to that shown in Figure 4 prior to 
15 the comparison of wireless system performance and from a three- 
dimensional perspective; 

Figure 6 shows a region following the comparison calculation of 
wireless system performance and is exemplary of the three-dimensional 
display of system performance from the present invention; 
20 Figure 7 shows the same region as in Figure 6 following the user 

reducing relative elevations of the vertices and thus altering the display; 

Figure 8 shows the same region as in Figure 7 following the user 
shading the display to produce an altered perspective of the performance 
results; and 

25 Figure 9 shows the same region as in Figure 6 following the user 

changing the view orientation to provide a different perspective of the 
performance results; 

Figure 10 shows a flow diagram describing a process for comparing 
performance prediction results; 

30 Figure 1 1 shows a flow diagram describing a process for comparing 
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performance predictions with measurement results; 

Figure 12 shows a flow diagram describing a process for comparing 
multiple measurement performance runs; 

Figure 13 shows a 3-D display of iconic representations for 
predicted performance data overlaying a 3-D physical environment; and 

Figure 14 shows a 3-D display of iconic representations for 
measurement data overlaying a 3-D physical environment. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 

Using the present method, it is now possible to assess the 
performance of a communication system to a much higher level of 
precision than previously possible. The present method is a significant 
advance over the prior art in the display of predicted performance of 
communication systems. The design of communication systems is often a 
very complex and arduous task, with a considerable amount of effort 
required to simply analyze the results of system performance. 

In the prior art, only a single performance prediction result could be 
analyzed at once. That is, having designed a communications system, 
there was no direct way to quickly visualize and compare advantages 
between having a hardware component in one communications network 
layout or another. In the present invention, a system is described where 
two or more predictions may be compared to analyze advantages or 
disadvantages between designs, models, or other factors. 

The present invention also allows for a measurement campaign to 
be compared with predicted performance data for analysis purposes. In the 
prior art, there are some implementations available for comparing 
measured and predicted data sets. Most, however, are not visual 
comparisons; moreover, those packages available for displaying visual 
comparisons between measurements and predictions are 2-D only. That is, 
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until this invention there is no way to folly visualize such comparisons for 
a communication network in a 3-D manner. 

The present invention describes several methods for visualization 
of comparisons between communication system performance values which 
are either predicted or measured. In all cases, the visualization described 
could be applied to measurements, predictions, comparisons between 
prediction models, comparisons between predictions of different 
communication systems, comparisons between predicted and measured 
data, comparisons between different measurement data sets, or 
comparisons between other data known now or in the future. 

Referring now to Figure 1, there is shown a two-dimensional (2-D) 
simplified example of a layout of a building floor plan. The method uses 3- 
D computer aided design (CAD) renditions of a building, or a collection of 
buildings and/or surrounding terrain and foliage. However, for simplicity 
of illustration a 2-D figure is used. The various physical objects within the 
environment such as external walls, internal walls and floors are assigned 
appropriate physical, electrical, and aesthetic values. For example, outside 
walls may be given a lOdB attenuation loss, signals passing through 
interior walls may be assigned 3 dB attenuation loss, and windows may 
show a 2 dB RF penetration loss. In addition to attenuation, the 
obstructions are assigned other properties including reflectivity and surface 
roughness. 

Figure 2 depicts the three-dimensional perspective of a building 
floor plan. Referring to Figure 2, there are several partitions within the 
building structure, including exterior concrete walls and interior sheetrock 
walls. 

Estimated partition electrical properties loss values can be extracted 
from extensive propogation measurements already published, which are 
deduced from field experience, or the partition losses of a particular object 
can be measured directly and optimized instantly using the present 
invention combined with those methods described in the copending 



21 



WO 02/13009 



PCT/USO 1/23603 



application Serial No. 09/221,985, entitled "System for Creating a 
Computer Model and Measurement Database of a Wireless 
Communication Network" filed by T. S. Rappaport and R. R. Skidmore. 
Once the appropriate physical and electrical parameters are specified, any 
5 desired number of hardware components of RF sources can be placed in 

the 3-D building database, and predicted RF performance values such as 
received signal strengths (RSSI), network throughput, packet latency, 
packet error rate, quality of service (QoS), bit or frame error rate, chip 
energy to interference ratio (Ec/Io), or carrier-to-interference (C/I) ratios 

10 can be obtained. Of course, other well known communication parameters 
for wired or wireless communications systems, known now or in the 
future, may be used for appropriate prediction values. The preferred 
method for generating a 3-D environmental database is disclosed in the co- 
pending application Serial No. 09/318,841, filed on May 26, 1999. The 

15 resulting definition utilizes a specially formatted vector database 

comprising lines and polygons that represent physical objects within the 
environment. The arrangement of lines and polygons in the database 
corresponds to physical objects in the environment. For example, a line or 
other shape in the database could represent a wall, a door, a tree, a building 

20 wall, or some other physical object in the modeled environment. 

From the standpoint of radio wave propagation, each 
obstruction/partition in an environment (i.e., each line or polygon in the 
drawing) has electromagnetic properties that affect a radio wave. When a 
radio wave signal intersects a physical surface, it interacts with the 

25 electromagnetic properties of the surface. A certain percentage of the radio 
wave reflects off of the surface and continues along an altered trajectory; a 
certain percentage of the radio wave penetrates through the surface and 
continues along its course; a certain percentage of the radio wave is 
scattered once it strikes the surface, etc. The electromagnetic properties 

30 given to the obstruction/partition defines this interaction, and thus defines 
the break down in percentages of the radio wave reacting in a given 
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manner upon intersection. In terms of the environmental database, each 
obstruction/partition has several parameters used to define its 
electromagnetic properties. For example, the attenuation factor of a 
partition determines the amount of power lost by a radio signal that 
penetrates through it; the reflectivity of a partition determines the portion 
of the radio signal reflected from it; and the surface roughness of a 
partition determines the portion of the radio signal that is scattered upon 
intersection. 

Once the 3-D environmental database has been constructed, the 
designer identifies and specifies the location and type of all wireless 
communication system equipment within the 3-D environmental. This 
point-and-click process involves the user selecting the desired hardware 
component from a computer parts database and then visually positioning, 
orienting, and interconnecting various hardware components within the 3- 
D environmental database to form complete wireless communication 
systems. The preferred embodiment of the computer parts database, 
referred to hereinafter as a parts list library, is more fully described in co- 
pending application Serial No. 09/3 18,842, filed on May 26, 1999. The 
resulting interconnected network of base station transceivers, cabling, 
connectors/splitters, amplifiers, antennas, and other RF hardware 
components (commonly known as a wireless distribution or antenna 
system) is preferably assembled using either a drag-and-drop or a pick-and- 
place technique and is graphically displayed overlaid with the 3-D 
environmental database. Each component utilizes electromechanical 
information available from the parts list library that fully describes the 
component in terms of its physical operating characteristics (e.g., the noise 
figure, frequency, radiation characteristics, etc.). This information is 
directly utilized during the prediction of wireless system performance 
metrics. 

Having a complete 3-D environmental model and a wireless 
communications system placed within the environment, the designer may 
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acquire performance data by running prediction models on the 
communications system, collecting RF measurement data from the actual 
site the environmental model represents, or by some other method known 
now or in the future. 

In the present invention, the designer may run performance 
prediction calculations, measure actual performance characteristics within 
an environment, or gather performance data using some other method 
known now or in the future. The novelty of the current method and 
apparatus is for displaying the results of measurements, performance 
prediction results, comparisons of measurements to performance prediction 
results, comparisons of two or more predicted performance results, and 
comparisons of two or more measurements. The 3-D visuahzation method 
allows an engineer or technician to rapidly determine the meaning or 
importance of the displayed information. 

To visualize performance or performance comparisons, several 
methods are employed in the present invention. When two sets of 
performance data are available, a direct visualization may be made. That 
is, statistics such as a difference or absolute difference, a percentage, a 
ratio such as decibels (dB), or some other statistics known now or in the 
future may be employed. Given two sets of performance data of equal 
size, the desired statistical calculations are performed on each element in 
the sets. In the event one of the data sets is larger than the other or the two 
data sets do not contain the same spatial elements, comparison calculations 
are performed on each element residing at the same spatial location in both 
data sets. Where there is misalignment between the two sets, an averaging, 
nearest neighbor, or random method could also be used to obtain 
registration in space. 

The resulting comparison calculations may be visualized directly 
on the 3-D environment database. Using variations in object shape, color, 
and/or height, the calculations may be visualized as shapes such as 
cylinders, rectangular prisms, spheres, cubes, or other objects directly in 
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the 3-D environment database to show performance comparisons. Figure 3 
depicts a comparison of performance values where cylinders of varying 
height and color are shown in 3-D to indicate differences between 
predicted and measured data. 

Where sufficiently many data points are available, a grid of many 
vertices indicating varying height and/or color may be overlaid on the 3-D 
environmental database to indicate spatial fluctuations in performance 
comparisons. Figure 4 shows an environmental database that has been 
segmented into a grid of vertices. Each vertex will correspond to a 
comparison data location. Figure 5 shows the same environmental 
database and overlaid grid from a 3-D perspective. 

Once the performance comparison is complete, the designer is free 
to configure the display of the results. The displayed results may be 
presented on a display screen, printed or otherwise 3-D rendered. The 
range of values to display and the color and other aesthetic characteristics 
such as saturation, hue, brightness, line type and width, transparency, 
surface texture, etc., to associate with each value are selectable, or may be 
automatically adjusted by the system. For example, if displaying 
comparisons between received signal strength intensities (RSSI), the user 
may select to only display those portions of the region having a relative 
RSSI difference within the range -20 dBm to 20 dBm, and may assign 
specific colors to correspond to compared RSSI values within that range. 
For example, the user may assign the color red to represent a relative RSSI 
difference between -20 dBm and -10 dBm, green to represent a relative 
RSSI difference between -9 dBm and 0 dBm, etc. Thus, the region is 
displayed as a pattern of fluctuating colors where the color assigned to 
each vertex within the grid corresponds to a certain value for the compared 
performance metric. Figure 6 depicts a 3-D comparison graphically, using 
variations in height and color to indicate differences between 
communication system performance. 

In similar fashion, each vertex of the grid or other point in space 
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representing a performance comparison data point is repositioned vertically 
in 3-D space. The elevation of each comparison data point directly 
corresponds to a certain value of compared performance. In the preferred 
embodiment of the invention, the user specifies the maximum and 
minimum elevation to assign to vertices, and the computer automatically 
scales the elevation of each comparison data point according to its 
compared performance value. For example, if the user selects a minimu m 
height of 0.0 meters and a maximum height of 20.0 meters, and the 
compared performance values for the entire grid range from -20 dBm to 20 
dBm for an RSSI difference comparison, if a given comparison data point 
has a value of 0 dBm it will be assigned an elevation of 10.0 meters. All 
elevations are specified relative to the 3-D environmental database. Figure 
7 depicts a 3-D comparison that has been repositioned for better viewing 
and analysis. 

Any combination of elevation, color, and other aesthetic 
characteristics may be used to customize the display of compared 
performance results. For example, signal-to-interference ratio (SIR) 
differences may be displayed as fluctuating elevation within the region 
while received signal strength (RSSI) differences are displayed by 
fluctuating colors. Data throughput percentages may be displayed as 
varying colors while bit error rate (BER) differences are displayed using 
differing line types. Any combination of elevation, color, and other 
aesthetic characteristics may be associated with any combination of 
compared performance result metric to produce the 3-D display. 

The results of the performance comparison are overlaid with or 
superimposed on the 3-D environmental database, allowing the user to 
analyze the performance of the current wireless communication system 
design. The display can be further customized through user interaction. 
The designer may reorient the viewing direction and zoom factor of the 
display to achieve varying perspectives of the comparison results. The 
results may be redisplayed in a variety of forms, including 3-D wireframe 
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with hidden lines removed, 3-D semi-transparent, 3-D shaded or patterned, 
3-D rendered, or 3-D photo-realistically rendered. The designer is free to 
interact with the displayed results in a variety of ways, including real-time 
panning and zooming to create a "fly-through" effect. Figure 8 depicts a 
5 comparison of system performance where the 3-D display has been 

appropriately shaded for viewing and analysis purposes. Similarly, Figure 
9 shows the same comparison from a different viewpoint. The compared 
performance results may be saved for later recovery and redisplay. 
In the event that more than two data sets are available for 

10 comparison, a sequential animation showing the graphical 3-D 

comparisons between any two sets can be shown. The designer is able to 
control which two sets are compared at any time, and can easily flip 
through a large number of comparisons. 

The present invention creates a new method and system for 

15 providing a way to conveniently visualize individual measurement points 
for rapid inference of meaning, as well as conveniently visualizing and 
rapidly inferring the meaning of differences between measurement rims 
collected within the same 3-D environment, using the same or different 
communication network designs. A measurement run is a series of 

20 measurements, usually performed by a technician or engineer within an 
environment (such as a city, a town, a campus, a group of buildings, or a 
building of interest), although such measurements may be carried out by 
non-technical people and may even be carried out remotely or 
autonomously (e.g., by measurement devices used by a number of 

25 technicians walking through the physical environment, each being 
outfitted with a measurement device which randomnly makes 
measurements and where these measurements are all shared; this being 

more adequately described in U.S. Serial No. 09/ , filed July 28, 

2000 entitled "System, Method and Apparatus for Portable Design, 

30 Deployment, Test and Optimization of a Communication Network, which 
is herein incorporated by reference). 
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We consider measurements to have a position location tagged with 
each measurement, using either automatic or manual means as taught in 
the co-pending application Serial Nos. 09/221,985, filed December 29, 
1998. As described subsequently, the present invention performs 
comparisons and provides novel displays for different measurement runs, 
which may be a collection of measured points that are collected from a 
single communication network at different times of day, on perhaps 
different days, using the same or different frequencies, using the same or 
different operational modes (where different operational modes may 
include, but not be limited to, one or more of the following: different data 
transmission rates, different packet sizes, different modulation techniques, 
different power levels, different psuedonoise code sequencing, different 
psuedonoise code chip timing, different optical frequency bands, different 
network protocols, different bandwidths, different multiple-access 
techniques, different antenna distribution systems, different antenna 
systems, different wiring architectures, different cabling methods or system 
distribution methods, different physical interconnections of system 
components to comprise the communication system, or different source or 
error correction coding methods), or under different traffic loading 
conditions (due to bandwidth variations, user density, or some other means 
that causes traffic flow or capacity to change over time). Alternatively, 
measurement runs may be made in a particular environment where two or 
more different communication systems are installed to provide network 
connectivity within the environment. This is common when one attempts 
to measure two or more competitive wireless service providers within a 
city or campus environment, or when one wishes to compare the 
performance of two or more different network architectures within a 
particular environment. 

As an example, a measurement run for a wireless inbuilding system 
might involve a technician using a mobile receiver who would canvass 
each floor of the building to measure the received signal from the installed 
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intmilding wireless office system. The technician might use the 
InFielder™ 3-D measurement system connected to a WaveSpy™ scanning 
receiver to measure, say, RSSI values, within the 3-D environment of 
interest, whereby a model of the 3-D environment resides within InFielder. 
5 The same or a different technician might then measure again the same 
building, either simultaneously, at a later date, or under different 
operational conditions. As shown subsequently, the present invention 
provides a novel way to display the difference of two or more 
measurement runs for comparison, and to display such differences so that 

10 rapid comparisons may be made by visualizing the resulting differences 
within the model of the 3-D environment. 

While the above example is for an in-building wireless system, it 
will be clear to one trained in the art of design, installation, and 
maintenance of any communication network that similar methods may be 

15 applied to the comparison and display of measurement runs for any type 
of communication network, and where such measurement runs could be 
made for a single network in a particular environment, or for two or 
more differently configured communication networks within the same 
physical environment, and that this approach may apply to optical 

20 networks, baseband networks, and a collection of wireless and wired 
networked devices which might share a common or different wired or 
wireless backbone(s). For an optical network within a building, for 
example, a measurement run would consist of making measurements at 
each wall terminal or cable junction box within the building. Rather than 

25 roam around, the measurement run for a fixed network would consist of 
taking samples at fixed locations. The present invention provides for 
display of such measurements within a 3-D environment as well as a 
convenient display for comparing two or more such measurement runs. 
Furthermore, measurement runs may include the collection of measured 

30 values or sample values, collected over time and space, of any or all of 
the various network system performance values taught earlier, and these 
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measurements could be conducted within the environment simultaneously 
by two or more measurers or measurement devices, or conducted at 
different times by one or more measurers or measurement devices. 
Alternatively, one can contemplate measurement methods that allow 
5 multiple sensors/receivers or multiple transmitters to simultaneously 

record measurement data, and such data and comparisons between data 
may be displayed using methods taught subsequently in this invention. 

A network system performance prediction result is a numerical 
value or a string of numerical values produced by a communication 

10 system modeler or simulator that serves as an estimate for a measured 
numerical value or string of numerical values that would be produced 
(e.g. measured or seen) by an actual communication system operating in 
the specified configuration and environment used for the performance 
prediction. The numerical values or string of numerical values represent 

15 certain communication parameters, quality metrics, or physical 

representations of the operating environment that can generally be 
measured by a network system communication device or a system of 
devices which can be used to predict the suitability or performance of a 
particular communication device within the environment. Appropriate 

20 and commonly used measurements and parameters and physical 

representations are taught earlier, and are well known to those skilled in 
the art of communication system design, network design, and 
measurement of communication systems. Network system performance 
prediction results are created by one or more analytical calculations, 

25 empirically applied models, or simulation outputs that are computed 

within a prediction engine, which may or may not use measurements at 
the time of computation. The network system performance prediction 
results allow engineers or technicians to properly install or design 
communication devices, and attempt to include the effects of the 

30 operating environment so they can be used by a network system designer 
to make sensible judgments and predictions about how well a proposed 
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system might perform. The complexities of a multiple-user local or wide 
area network are extreme, and it is not possible to model all of the 
variables which cause a particular network to perform a particular way at 
a particular time and spatial location. However, researchers have 
5 developed key findings that help isolate the most important factors that 
dictate network performance, and these most important factors are 
generally used in the computations that yield network system 
performance prediction results. For example, as shown in Rappaport 
(T.S. Rappaport, Wireless Communications, Principles and Practice, 

10 Prentice Hall, 1996, NJ), in a wireless communication system, if the 
physical distance between a transmitter and receiver is known, and the 
physical environment is known and modeled for various partition losses, 
it is possible to create an analytical site-specific communications model 
that yields the unequalized bit error rate for a wireless device that uses 

15 BPSK modulation. From this model, it becomes possible to carry out 
network designs, based on bit error rate, in a 3-D environment. Similar 
models, of the analytical, empirical, and simulation-based kind, exist for 
optical, wireless, and baseband networks. 

Network system performance prediction results may be computed 

20 within any environment (such as a city, a town, a campus, a group of 
buildings, or a building of interest). As described subsequently, the 
present invention performs comparisons and provides novel displays for 
comparing the results of different network system performance prediction 
results, whereby each collection of network system performance prediction 

25 results performed throughout a part of the modeled environment is called a 
prediction run, where a prediction run is a collection of one or more 
predicted values at points or grids or volumes over space that are produced 
from one or more modeled communication network(s) simulated in the 
prediction engine, but which may be simulated multiple times to produce 

30 different resulting prediction runs that may be compared , using the same 
or different frequencies, using the same or different operational modes 
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(where different operational modes may include, but not be limited to, one 
or more of the following: different data transmission rates, different 
packet sizes, different modulation techniques, different power levels, 
different pseudo-noise code sequencing, different pseudo-noise code chip 
5 timing, different optical frequency bands, different network protocols, 
different bandwidths, different multiple-access techniques, different 
antenna distribution systems, different antenna systems, different wiring 
architectures, different cabling methods or system distribution methods, 
different physical interconnections of system components to comprise the 

10 communication system, or different source or error correction coding 

methods), or under different traffic loading conditions (due to bandwidth 
variations, user density, or some other means that causes traffic flow or 
capacity to change over time). Alternatively, network system performance 
prediction results may be computed in a particular environment where two 

15 or more different communication systems are modeled to provide network 
connectivity within the environment. This is common when one attempts 
to understand or predict how alternative communication network 
architectures within a particular environment might perform. 

As an example, network system performance results might be 

20 computed to create a prediction run for predicted signal-to-noise ratio 
(SNR) for a wireless inbuilding system throughout a building. If the 
models used in the prediction engine were sufficiently accurate, then such 
a process would eliminate the need for measurement runs in order to 
install a properly functioning system. In the prediction engine 

25 contemplated by SitePlanner ®, which is disclosed in part in all of the 
cross referenced co-pending applications listed above, various 
performance parameters which provide electrical, mechanical, numerical, 
or physical descriptions of the modeled communication system must be 
provided. These performance parameters may include the addition, 

30 removal, replacement, re-connection, re-orientation, or some other 

modification of one or more attributes which describe one or more of the 
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effects that are required for accurate simulation performance of the 
prediction engine. Some examples of such inputs might include: physical 
locations of transmitters, antennas, RF distribution lines, connectors, 
splitters, base station controllers, switches, optical-to-RF couplers; cable 
5 losses, sphtter losses; antenna patterns; power levels of the transmitters; 
gains of the amplifiers, and frequencies to be simulated, must be applied 
to the input of the prediction engine. While the list in the preceding 
sentence is not meant to be exhaustive, it demonstrates the level of detail 
and interconnectivity dependencies that are considered to properly model 

10 the transmission system, both physically and electrically, as it would 
actually be installed in a real building. This is because of the 
visualization capabilities of the invention which focuses on illustrating the 
network as it really appears in true life. Other inputs required by the 
prediction engine include a 2-D or 3-D computerized model of the actual 

15 operating environment, with specified floor locations, ceiling heights, 
and other 3-D information, or maps which are either 2-D or 3-D. To 
compute, store, and display the network system performance results in 
the 3-D environmental model, particular points, grids, or zones must be 
specified or requested by the user in order to determine the exact 3-D 

20 location of where the network system performance results (in this case, 
SNR) will be computed and displayed. Upon completion of a sequence 
of simulations throughout the environment, a prediction run will be 
created and displayed. 

Prediction runs produced by the prediction engine may consider 

25 alternate models, communication network architectures, or different 

operating modes within the same physical environment, as well as other 
obvious perturbations that would be appropriate and interesting to a 
wireless network designer, either now or in the future. As shown 
subsequently, the present invention provides a novel way to display the 

30 difference of two or more prediction runs for comparison, and to display 
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such differences so that rapid comparisons may be made by visualizing the 
resulting differences within the model of the 3-D environment. 

While the above example is for an in-building wireless system, it 
will be clear to one trained in the art of design, simulation or analysis of 
5 any communication network that similar methods may be applied to the 

comparison and display of prediction performance results and prediction 
runs for any type of communication network, and where such predictions 
could be made for a single network modeled in a particular environment, 
or for two or more differently configured communication networks 

10 modeled within the same physical environment, and that this approach may 
apply to networks and systems modeled as optical networks, baseband 
networks, and a collection of wireless and wired networked devices which 
might share a common or different wired or wireless backbone(s). For 
predictions of a wired optical network within a building, for example, 

1 5 simulations designed to produce network system prediction results would 
consist of providing the proper inputs and environmental model to the 
prediction engine, and then specifying output values be provided in the 
modeled environment at the exact location of each wall terminal, port, or 
cable junction box within the modeled building. The present invention 

20 provides for display of differences between two or more prediction runs 
within a 3-D environment as well as a convenient display for comparing 
two or more such prediction runs. Furthermore, prediction runs may 
include collections of predicted values, collected over time and space, for 
any or all of the various network system performance values taught earlier, 

25 and these predicted values could be acquired within the model of the 

environment simultaneously by executing the prediction engine on two or 
more computers, which may be connected as parallel processing machines, 
or independent computing devices, or which may be predicted at different 
times by one or more computers each running one or more prediction 

30 engines. Alternatively, we contemplate prediction methods that allow 
multiple locations in the environmental model to be computed for and 
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displayed simultaneously, and such predicted data and comparisons 
between data may be displayed using methods taught subsequently in this 
invention. 

In addition to the above considerations, the present invention 
5 provides a means of displaying the differences between measured data and 

predicted data in a convenient manner which yields great insight into 
actual versus predicted performance of any communications network. 
Based on the above teaching, it should be clear that measured data and 
predicted data may be displayed in a 3-D environment, and may be 

10 overlaid upon each other in space, in order to provide a registration of 
measured and predicted values. In this manner, it is possible to compare 
measurement runs to prediction runs, so long as the measurements are 
collected at points which are contained in the same environment which is 
modeled by the prediction engine. Measurement points may be at the same 

15 locations as prediction points or comparisons may be made between 

measurement points which are close to prediction points as specified 
above. Also, simply plotting measurement and predicted points which are 
not co-located still allows easy 3D visualization of differences, for rapid 
comparisons. It is clear to one trained in data processing and error analysis 

20 how novel visualization techniques that apply to: a) measured data, b) the 
comparison of measured data, c) predicted data, and d) the comparison of 
predicted data could also be applied to the comparison of measured to 
predicted data. Using the novel visualization methods which are 
described subsequently to compare measured versus predicted values 

25 offers tremendous power for engineers who seek to develop and optimize 
and use prediction models that perform most accurately in particular 
physical environments. 

Now consider a practical user of a wireless design system. If the 
designer wishes to use predicted performance data for the basis of 

30 comparisons, he or she selects the wireless communication system 

performance predictive model to utilize. The preferred embodiment uses a 
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number of methods to predict and optimize performance in a wireless 
communication network. These include methods to incorporate and build 
upon performance prediction techniques such as those described in the 
previously cited and following technical reports and papers: "Interactive 
Coverage Region and System Design Simulation for Wireless 
Communication Systems in Multi-floored Indoor Environments: SMT 
Plus," IEEE ICUPC '96 Proceedings, by R. Skidmore, T. Rappaport, and 
AX. Abbott, and "SitePlanner 3.16 for Windows 95/98/NT User's 
Manual", Wireless Valley Communications, Inc. 1999, all of which are 
hereby incorporated by reference. It would be apparent to one skilled in 
the art how to apply other wireless communication system performance 
models to this method. 

When making comparisons using prediction data, several methods 
may be employed to visualize the results. As described in co-pending 
application 09/352,678, entitled "System for the Three-Dimensional 
Display of Wireless Communications System Performance", the present 
method may employ a grid of vertices placed over a region of any shape or 
size to cover the predicted area. At each vertex in the grid, the 
communications network performance is predicted, and the set of all 
performance predictions may be stored, logged, or displayed as described 
in patent application 09/352,678. 

Other methods for generating a set of prediction comparison data 
may also be employed. As described in co-pending application 
09/3 18,840, entitled "Method and System for Automated Optimization of 
Antenna Positioning in 3-D", the present invention can make use of one or 
more locations in the 3-D environment, termed "watch points", for making 
predictions. Using the aforementioned prediction models, the performance 
values at each watch point are calculated and then stored, logged, or 
displayed as described in patent application 09/318,840. 

Other methods could be employed for generating prediction 
comparison data sets. It should be obvious to one of skill in the art that the 
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novelty of the present invention will remain regardless of how the 
prediction data set is generated. The aforementioned methods for 
generating a data set are simply given as examples from the current 
embodiment. 

5 Referring now to Figure 10, there is shown a flow diagram 

according to the present invention for comparing prediction data. Having 
an environmental model 100 available for making predictions, a system of 
RF hardware devices 1 10 is positioned in the environmental model. An 
initial set of prediction data 120 is made using a selected prediction model. 

10 The communications system may be redesigned in block 130 by adding, 
removing, or replacing hardware RF components, or by changing the 
layout, orientation, or other electrical or mechanical parameters of the 
existing hardware RF components. A second prediction data set 140 is 
then obtained for the purposes of comparison with the initial prediction 

15 data. Because each prediction data set is stored on a computer, any two or 
more predictions may be compared with another in block 150 and those 
comparisons stored in block 160. The designer is free to recursively alter 
the communications system as necessary and compare how the changes 
impact predicted performance. 

20 It should be obvious to one of skill in the art that, rather than 

comparing two communication systems separately, a comparison could be 
made between two or more communication systems existing at a single 
time in a physical environment. Existing prior art such as SitePlanner® 
from Wireless Valley Communications, Inc. are already capable of 

25 performing such calculations, and hence are not covered by the present 
invention. One of the novelties of the present invention is in comparing 
changes made to a communication systems and visualizing the changes in 
the form of a direct comparisoa 

None of the existing prior art is capable of displaying comparisons 

30 between measured and predicted data on top of a 3-D environmental 

model. Using the present invention, measurement data collected may be 
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used as a performance data set for comparison. As described in co- 
pending application 09/221,985, entitled "System for Creating a Computer 
Model and Measurement Database of a Wireless Communicatioa 
Network", measurement data may be collected from a variety of radio 
5 receivers attached to a computer running SitePlannerd^. 

Referring now to Figure 1 1, a flow diagram is shown for comparing 
measured data with predicted data. Having an environmental model 200 
available for making predictions, a system of RF hardware devices 210 is 
positioned in the environmental model A set of prediction data 220 is 

10 made using a selected prediction model. The designed communication 
system is built into the real-world physical environment in function block 
230, and measurement data is collected in 240 using an attached radio 
receiver. With available measurement data, a comparison is made between 
the predicted performance data set and the measurement data set in 

15 function block 250. The comparison data is displayed and/or stored as 
previously discussed in block 260. 

Figure 12 shows a flow diagram for comparing multiple 
measurement data sets with each other. Having an environmental model 
300 available for making predictions, a system of RF hardware devices 310 

20 is positioned in the environmental model. The designed communication 
system is built into the real-world physical environment in function block 
320, and measurement data is collected in 330 using an attached radio 
receiver. The entire design, build-out, and measurement collection 
procedure may be repeated many times, and measurement data sets may be 

25 compared and stored and displayed repeatedly in blocks 340 and 350. 

Referring now to Figure 13, the display of predicted performance 
metrics at each watch point can take the form of shaded colored cylindrical 
markers overlaid with the 3-D environmental model. In this form of 
presentation, both the height and color of the cylindrical graphical entities 

30 corresponds to the predicted performance metrics at that location in the 3- 
D environmental model. The designer has full control of both the range of 
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colors and the range of heights that the cylindrical graphical entities can 
adopt. This form of presentation enables the designer to rapidly assess the 
performance of the wireless communication system by providing a much 
more dramatic display of the predicted results. In Figure 13, as the 
5 designer moves the mouse or other computer pointing device cursor, an 
antenna component 601 is effectively relocated and/or reoriented within 
the 3-D environmental model. In real-time, the new predicted performance 
metrics given the new position and/or orientation of the antenna 
component are represented at each of the watch points 602 as three- 

10 dimensional shaded colored cylinders. One skilled in the art could see how 
the watch point graphical entities could easily assume the form of three- 
dimensional cones, pyramids, cubes, or any other three-dimensional 
graphical entity as well with similar results. 

Referring now to Figure 14, the display of measured performance 

15 metrics at each watch point can take the form of shaded colored cylindrical 
markers overlaid with the 3-D environmental model. Similar to Figure 13, 
both the height and color of the cylindrical graphical entities corresponds 
to the measured performance metrics at that location in the 3-D 
environmental model. The designer has foil control of both the range of 

20 colors and the range of heights that the cylindrical graphical entities can 

adopt. This form of presentation enables the designer to rapidly assess the 
performance of the wireless communication system by providing a much 
more dramatic display of the measured results. For example, with the 
present invention, differences between measurement runs and/or prediction 

25 runs can be easily visualized in the 3-D environment, even if some or all of 
the individual data points to be compared are not co-located or interpolated 
to approximate co-location. By having a 3-D visualization where height, 
width, color, shape, thickness are easily discernible between data sets, the 
user can quickly and visually compare results. Furthermore, the vertical 

30 display nature of the 3-D watchpoints or a collection of watchpoints that 
form a grid of watchpoints appear to rise above the displayed physical 
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environment. One skilled in the art could see how the watch point 
graphical entities could easily assume the form of three-dimensional cones, 
pyramids, cubes, or any other three-dimensional graphical entity as well 
with similar results. 

While the invention has been described in terms of a single 
preferred embodiment, those skilled in the art will recognize that the 
invention can be practiced with modification within the spirit and scope of 
the appended claims. For example, this invention may not be limited just to 
wireless communication systems, but may be used to present any type of 
electromagnetic characteristics superimposed on any simulated three- 
dimensional environment. For example, the invention would find 
application in the next generation field of micromachines and 
nanomachines or micro-electrical-mechanical machines (MEMS). These 
machines are extremely small yet highly sophisticated functional elements 
that allow them to perform complicated tasks in hard-to-access locations, 
such as inside the human body, in plumbing, in jet engines, etc. It will be 
necessary to both wirelessly communicate with these machines as well as 
wirelessly provide power for these machines, such as in the form of RF 
pulses, infrared (IR) light or any other form of electromagnetic medium. 
The present invention would therefore facilitate the modeling and 
presentation of this or any other wireless electromagnetic system. 
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CLAIMS 

We claim: 

1. A method for designing, deploying or optimizing a communications 
network, comprising the steps of: 

providing a computerized model which represents a physical 
environment in which a communications network is or will be installed, 
said computerized model providing a display of at least a portion of said 
physical environment; 

providing performance attributes for a plurality of system 
components which may be used in said physical environment; 

selecting specific components from said plurality of system 
components for use in said computerized model; 

representing said selected specific components in said display; 
selecting specific points within said display where performance 
data is desired; 

running prediction models using the computerized model and said 
performance attributes to predict performance characteristics of a 
communications network composed of said selected specific components, 
said prediction models providing predicted performance data for said 
selected specific points; and 

displaying results from said prediction models on said display at 
said selected specific points in the form of one or more icons. 

1 2. The method of claim 1 wherein said display is three dimensional. 

1 3 . The method of claim 1 wherein said icon is three dimensional. 

1 4. The method of claim 1 wherein both said display and said icons are 

2 three dimensional. 
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1 5 . The method of claim 4 wherein said icon is depicted as a graphical 

2 cylinder where an attribute selected from the group consisting of height, 

3 radius, brightness, color, hue, saturation, line type and width, transparency, 

4 and surface texture varies depending on the performance data. 

1 6. The method of claim 4 wherein said icon has an attribute selected from 

2 the group consisting of height, radius, brightness, color, hue, saturation, 

3 line type and width, transparency, and surface texture varies depending on 

4 the performance data. 

1 7. An apparatus for designing, deploying or optimizing a communications 

2 network, comprising: 

3 a means for providing a computerized model which represents a 

4 physical environment in which a communications network is or will be 

5 installed, said computerized model providing a display of at least a portion 

6 of said physical environment; 

7 a means for providing performance attributes for a plurality of 

8 system components which may be used in said physical environment; 

9 a means for selecting specific components from said plurality of 

10 system components for use in said computerized model; 

11 a means for representing said selected specific components in said 

12 display; 

13 a means for selecting specific points within said display where 

14 performance data is desired; 

15 a means for running prediction models using the computerized 

16 model and said performance attributes to predict performance 

17 characteristics of a communications network composed of said selected 

1 8 specific components, said prediction models providing predicted 

19 performance data for said selected specific points; and 

20 a means for displaying results from said prediction models on said 
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21 display at said selected specific points in the form of one or more icons. 

1 8. The apparatus of claim 7 wherein said display is three dimensional. 

1 9. The apparatus of claim 7 wherein said icon is three dimensional. 

1 10. The apparatus of claim 7 wherein both said display and said icon is 

2 three dimensional. 

1 11. The apparatus of claim 1 0 wherein said icon is depicted as a graphical 

2 cylinder where an attribute selected from the group consisting of height, 

3 radius, brightness, color, hue, saturation, line type and width, transparency, 

4 and surface texture varies depending on the performance data. 

1 12. The apparatus of claim 10 wherein said icon has an attribute selected 

2 from the group consisting of height, radius, brightness, color, hue, 

3 saturation, line type and width, transparency, and surface texture varies 

4 depending on the performance data. 

1 13. A method for designing, deploying or optimizing a communications 

2 network, comprising the steps of: 

3 providing a computerized model which represents a physical 

4 environment in which a communications network is or will be installed, 

5 said computerized model providing a display of at least a portion of said 

6 physical environment; 

7 providing performance attributes for a plurality of system 

8 components which may be used in said physical environment; 

9 selecting specific components from said plurality of system 

10 components for use in said computerized model; 

1 1 representing said selected specific components in said display; 

12 selecting specific points within said display where performance 
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13 data is desired; 

14 running prediction models using the computerized model and said 

1 5 performance attributes to predict performance characteristics of a 

16 communications network composed of said selected specific components, 

17 said prediction models providing predicted performance data for said 

1 8 selected specific points; 

1 9 measuring actual performance data for said physical environment; 

20 and 

21 comparing said actual performance data to said predicted 

22 performance data. 

1 14. The method of claim 13 further comprising the step of displaying a 

2 comparative result from said comparing step as an icon on said display. 

1 15. The method of claim 14 wherein said icon and said display are three 

2 dimensional. 

1 16. The method of claim 15 wherein said icon is depicted as a graphical 

2 cylinder where an attribute selected from the group consisting of height, 

3 radius, brightness, color, hue, saturation, line type and width, transparency, 

4 and surface texture varies depending on the performance data. 

1 17. The method of claim 15 said icon has an attribute selected from the 

2 group consisting of height, radius, brightness, color, hue, saturation, line 

3 type and width, transparency, and surface texture varies depending on the 

4 performance data. 

1 18. A method for designing, deploying or optimizing a communications 

2 network, comprising the steps of: 

3 providing a computerized model which represents a physical 
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4 environment in which a communications network is or will be installed, 

5 said computerized model providing a display of at least a portion of said 

6 physical environment; 

7 providing performance attributes for a plurality of system 

8 components which may be used in said physical environment; 

9 selecting specific components from said plurality of system 

10 components for use in said computerized model; 

1 1 representing said selected specific components in said display; 

12 selecting specific points within said display where performance 

13 data is desired; 

14 running at least two different prediction models using the 

1 5 computerized model and said performance attributes to predict 

16 performance characteristics of a communications network composed of 

17 said selected specific components, said prediction models providing at 

18 least two predicted performance data for said selected specific points; and 

19 comparing said at least two predicted performance data. 

1 19. The method of claim 18 further comprising the step of displaying a 

2 comparative result from said comparing step as an icon on said display. 

1 20. The method of claim 19 wherein said icon and said display are three 

2 dimensional. 

1 21 . The method of claim 20 wherein said icon is depicted as a graphical 

2 cylinder where an attribute selected from the group consisting of height, 

3 radius, brightness, color, hue, saturation, line type and width, transparency, 

4 and surface texture varies depending on the performance data. 

1 22. The method of claim 20 whereinsaid icon has an attribute selected 

2 from the group consisting of height, radius, brightness, color, hue, 

3 saturation, line type and width, transparency, and surface texture varies 
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depending on the performance data. 

23. A method for designing, deploying or optimizing a communications 
network, comprising the steps of: 

providing a computerized model which represents a physical 
environment in which a communications network is or will be installed, 
said computerized model providing a display of at least a portion of said 
physical environment; 

providing performance attributes for a plurality of system 
components which may be used in said physical environment; 

selecting specific components from said plurality of system 
components for use in said computerized model; 

representing said selected specific components in said display; 

selecting specific points within said display where performance 
data is desired; 

running at least one predictive model using the computerized 
model and said performance attributes to predict performance 
characteristics of a communications network composed of said selected 
specific components, said step of running being performed at least two 
times where performance parameters in said predictive model have 
changed between said at least two times so as to provide at least two 
predicted performance data for said selected specific points; and 

comparing said at least two predicted performance data. 

24. The method of claim 23 further comprising the step of displaying a 
comparative result from said comparing step as an icon on said display. 

25. The method of claim 24 wherein said icon and said display are three 
dimensional. 

26. The method of claim 25 wherein said icon is depicted as a graphical 
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2 cylinder where an attribute selected from the group consisting of height, 

3 radius, brightness, color, hue, saturation, line type and width, transparency, 

4 and surface texture varies depending on the performance data. 

1 27. The method of claim 25 wherein said icon has an attribute selected 

2 from the group consisting of height, radius, brightness, color, hue, 

3 saturation, line type and width, transparency, and surface texture varies 

4 depending on the performance data. 

1 28. A method for designing, deploying or optimizing a communications 

2 network, comprising the steps of: 

3 providing a computerized model which represents a physical 

4 environment in which a communications network is or will be installed, 

5 said computerized model providing a display of at least a portion of said 

6 physical environment; 

7 providing performance attributes for a plurality of system 

8 components which may be used in said physical environment; 

9 selecting specific components from said plurality of system 

10 components for use in said computerized model; 

1 1 representing said selected specific components in said display; 

12 selecting specific points within said display where performance 

13 data is desired; 

14 measuring actual performance data for said physical environment 

15 which correspond to said specific points, said measuring step being 

16 performed using different measurement devices, or being performed at 

17 different time periods such that at least two sets of measurement data are 

18 obtained; and 

19 comparing said at least two sets of measurement data. 

1 29. The method of claim 28 further comprising the step of displaying a 

2 comparative result from said comparison step as an icon on said display. 
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1 30. The method of claim 29 wherein said icon and said display are three 

2 dimensional. 

1 31. The method of claim 3 0 wherein said icon is depicted as a graphical 

2 cylinder where an attribute selected from the group consisting of height, 

3 radius, brightness, color, hue, saturation, line type and width, transparency, 

4 and surface texture varies depending on the performance data. 

1 32. The method of claim 30 wherein said icon has an attribute selected 

2 from the group consisting of height, radius, brightness, color, hue, 

3 saturation, line type and width, transparency, and surface texture varies 

4 depending on the performance data. 
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